Stability of the quantum spin Hall effect: 
effects of interactions, disorder, and Z 2 topology 
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The stability to interactions and disorder of the quantum spin Hall effect (QSHE) proposed for 
time-reversal-invariant 2D systems is discussed. The QSHE requires an energy gap in the bulk and 
gapless edge modes that conduct spin-up and spin-down excitations in opposite directions. When 
the number of Kramers pairs of edge modes is odd, certain one-particle scattering processes are 
forbidden due to a topological Z2 index. We show that in a many-body description, there are other 
scattering processes that can localize the edge modes and destroy the QSHE: the region of stability 
for both classes of models (even or odd number of Kramers pairs) is obtained explicitly in the chiral 
boson theory. For a single Kramers pair the QSHE is stable to weak interactions and disorder, 
while for two Kramers pairs it is not; however, the two-pair case can be stabilized by either finite 
attractive or repulsive interactions. For the simplest case of a single pair of edge modes, it is shown 
that changing the screening length in an edge with screened Coulomb interactions can be used to 
drive a phase transition between the QSHE state and the ordinary insulator. 



I. INTRODUCTION 



The possibility of an intrinsic spin Hall effect in sys- 
tems with time-reversal symmetry (T) was first proposed 
for gapless semiconducting systems 1 ^ and led to sev- 
eral experimental searches^. While a consensus has 
emerged that for Rashba-type spin-orbit coupling, the 
intrinsic effect is sensitive to disorder 5 ' 6 (but not for p- 
type coupling^ in 2D or 3D), recent interes^^*ii^ 
has concentrated on a "quantum spin Hall effect" in two- 
dimensional systems with an energy gap in the bulk. 
These models can be thought of as multiple copies of 
the charge Hall effect with different values of the spin, 
arranged so that T is unbroken but the spin current is 
nonzero in the presence of an applied electric field: for a 
fixed value of the spin, T is broken and there is a quan- 
tum Hall effect with zero net orbital flu:?^. The energy 
gap in the bulk means that the dominant effects of weak 
potential scattering are on the gapless modes at the edge 
of the 2D system. 

An important question is whether such constructions 
are stable to potential scattering and other effects in real 
experiments. Recently a Z2 topological classification 14 
has been proposed that is in many ways analogous to 
the Chern-number classification of integer quantum Hall 
states. In particular, a single-particle description 1 ^ sug- 
gests that models distinguished from the insulator in the 
Z2 classification*!*^ are qualitatively more stable than 
other models of a two-dimensional quantum spin Hall 
effec1iii*i£. This stability is argued on the basis of single- 
particle potential scattering, and an alternate form of 
this argument is given in Section II. The simplest de- 
scription of this Z2 classification is as whether the num- 
ber of time-reversed pairs of gapless edge modes is even 
(including the ordinary insulator) or odd. A more pre- 
cise definition 1 ^ is made using the Z x Z2 classification of 
wavefunctions with a period-4 involution (time-reversal) 



using real K-theory^ This definition of the Z2 classifica- 
tion is "topological" (invariant under small deformations 
of the single-particle wavefunctions) but depends on a 
precise symmetry (time- reversal). 

This paper clarifies by explicit calculation the nature 
of the difference between the two topological classes of 
models: the effect of the Z2 topological number is to re- 
strict certain one-particle scattering processes that tend 
to eliminate the QSHE, but there are additional unre- 
stricted multiparticle processes that drive the same insta- 
bility and are unaffected by this conservation law. Our 
emphasis is on universal properties of the effective the- 
ory; at least four^iSiii* 1 ^ specific single-particle Hamilto- 
nians giving rise to a QSHE band structure have already 
been introduced, but these can be grouped into universal- 
ity classes based on the number of Kramers pairs at the 
edge (one or two). As expected, the Z 2 index does lead 
to a larger region of stability for a single Kramers pair 
of edge modes than for two pairs. However, even though 
for one pair repulsive interactions only reduce the sta- 
bility to disorder, for two pairs repulsive interactions of 
moderate strength can unexpectedly stabilize the QSHE 
to disorder. We compute the region of stability for the 
most experimentally relevant cases with and without the 
Z2 symmetry. 

One way to understand the extraordinary precision of 
the charge quantum Hall effect is by considering possible 
scattering processes at the edge. The gapless modes at 
the edge are determined by an integer matrix K that is 
inherited from the Chern-Simons effective theory of the 
bulk condensate. For a chiral edge (all eigenvalues of K 
have the same sign) , all low-energy excitations at the edge 
have the same direction of propagation: all integer quan- 
tum Hall states fall into this class. Potential scattering 
cannot modify the conduction in any order of perturba- 
tion theory because there is no low-energy mode in the 
opposite direction into which quasiparticles can scatter. 

In nonchiral edge states with modes propagating in 
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both directions, there are allowed quasiparticle scatter- 
ing processes that transfer quasiparticles from one mode 
to another and can reduce the edge conductance. It was 
proposed by Kane, Fisher, and Polchinskii& that an in- 
stability to such scattering occurs in the v — 2/3 edge 
and is actually required to explain the observed value of 
the charge conductance. The charge quantum Hall ef- 
fect depend on the breaking of time-reversal symmetry, 
so that even in nonchiral edge states the left-moving sec- 
tor of edge excitations is topologically distinct from the 
right-moving sector. 



In contrast, the quantum spin Hall effect exists in sys- 
tems with unbroken time-reversal symmetry: in this case, 
the left-moving sector and right-moving sector at the 
edge are time-reversed copies of one another. For ex- 
ample, one sector may move left with spin up, while the 
other sector moves right with spin down. It is then intu- 
itively plausible that, depending on the interactions and 
scattering at the edge, the left-moving and right-moving 
sectors could scatter into each other strongly 29 and both 
localize, so that no gapless propagating modes remain 
and the spin conductance along the edge is zero. This 
particular class of ID localization problems with inter- 
actions and disorder is directly relevant to whether the 
quantum spin Hall effect is observable in experiment. 



In terms of edge excitations, the Z2 classification found 
in Ref . ^| creates a restriction on allowed scattering pro- 
cesses in some "topologically ordered" band structures. 
Our main focus in the following is on the phase diagram 
of the QSHE with interactions and potential scattering 
at the edge. The edge theory we study in the simplest 
case contains two modes moving in opposite directions 
that are T conjugates (i.e., form a Kramers pair): the 
two modes may carry opposite spins along some axis, so 
that there is a nonzero spin current in an applied electric 
field. Such an edge has half as many degrees of free- 
dom as an ordinary nonchiral Luttinger liquid with spin. 
Our description of the edge is as a pair of chiral Lut- 
tinger liquidsiii^ with interactions and scattering: the 
kinetic term of this edge theory arises in the QSHE from 
a bulk theory of two Chern-Simons fields with opposite 
coefficients 10 . Such paired Chern-Simons theories that 
are T- and parity-symmetric have also been introduced 
recently for topological quantum computation^^! The 
edge states of these models are similar to those discussed 
here and are needed in some experimental proposals 21 to 
measure nonabelian statistics directly. We discuss modi- 
fications required for more general cases and experimen- 
tal consequences in closing. One prediction for exper- 
iments is that by increasing the screening length of the 
Coulomb interaction in the case of a single Kramers pair, 
it is possible to drive an abrupt transition from the QSHE 
state to an insulator. 



II. SPINFUL EDGE EXCITATIONS AND 
TIME-REVERSAL SYMMETRY 

We start by giving an alternate explanation of the Z2 
classification found by Kane and Melei^, based on un- 
broken T, that is more natural for excitations of a many- 
particle system. Consider the scattering induced by a 
time-reversal-symmetric perturbation operator W: ef- 
fects of such scattering are expected to be significant on 
gapless excitations, which are localized near the edge. 
Let T be the time-reversal operator: then [H',T] = 0. T 
is an antiunitary operator and can be decomposed into 
a product of a unitary operator U and complex conjuga- 
tion K: T = UK, with Kip — tp*. From this form, it is 
obvious that T satisfies the following requirements: 

(Ta\TP) = (Ka\K(3) = (f3\a). (1) 

For a system with angular momentum \j,m), T\j,m) = 
i 2m \j, —to). This indicates that for bosons or for an even 
number of fermions, T 2 = 1, while for an odd number of 
fermions, T 2 = —1—. 

Suppose a time-reversal-symmetric perturbation W is 
turned on in a ID system with fermionic spin-half excita- 
tions. Imagine that at t — 0, n right-movers are excited, 
and consider whether they can be scattered back to n 
left-movers by a random potential; specifically, assume 
that the final state of n left-movers \ip) is the T conju- 
gates of the right-moving initial state \(f>). The matrix 
element for H ' to connect these states is 

(m'\4>) = (Tm'\4>) 

= (TH'cl>\T 2 <j>} = {-l) n (TH'<(>\<t>) 

= (-ir(H'T<p\c/>) = (2) 

The second line made use of equation (Q. For n odd, 
this process is forbidden because the matrix element has 
to be zero. However, for n even, this process can take 
place as shown explicitly below. 

If there is only one Kramers pair of edge modes, one 
moving right and one moving left with opposite spin, then 
the only states degenerate in energy are connected by T. 
The above symmetry argument proves in this case that 
one excitation cannot be scattered by a time-reversal- 
symmetric perturbation. If there are two Kramers dou- 
blets, two degenerate states are not necessarily connected 
by time reversal and can be mixed. However, two-particle 
backscattering is not forbidden by T, even if there is only 
one Kramers doublet. Two right-movers excited at t = 
can be mixed with two left-movers; if this backscattering 
is relevant, it will eliminate the QSHE as explained in 
the following section. 

An explicit two-particle process with a nonzero am- 
plitude is shown in Fig. ^ consider two initially right- 
moving particles with momenta p\ and P2, and allow a 
momentum-conserving interaction Vk 1 ,k 2 ^k 3 ,k 4 , as well as 
potential scattering H'. First a particle at p\ can be 
flipped by potential scattering to an intermediate state 
— P2, then interact conserving momentum with the par- 
ticle at pi to form another intermediate state (— pi,pi), 
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FIG. 1: An allowed two-particle backscattering process: (a) 
particle at momentum pi scatters to intermediate state —p2\ 
(b) particles at ±p2 interact and become intermediate states 
±pi; (c) and (d), particle at intermediate state pi backscatters 
to state —p2- 



from which the particle of momentum p\ state can be 
backscattcred to — p2- This process has a nonzero rate in 
third-order perturbation theory and therefore should be 
included in a proper description of the edge. The goal 
of the following section is to understand quantitatively 
how the restriction on one-particle scattering increases 
the stability of the QSHE. 



III. EDGES WITH A SINGLE KRAMERS PAIR 
OF MODES 

Edges of quantum Hall systems are described by a chi- 
ral Luttinger liquid (xLL) theory related to the topolog- 
ical orders of the bulk quantum Hall state>iii& All edges 
of a certain state have the same universal statistics ma- 
trix K inherited from the bulk Chern-Simons effective 
theory. The x^L action in imaginary time for a clean 
edge of a QH state with statistics matrix K contains 
N = dim K bosonic fields Si and has the form 23 



So = J dxdr [Kijdxdtdrdj + Vijd x <pid x (j)j] 



(3) 



where the sum over repeated indices is assumed. K is 
a symmetric integer matrix and V a symmetric positive 
matrix. K gives the topological properties of the edge: 
the types of quasiparticles and their relative statistics. 
V, which contains interactions (off-diagonal terms) and 
velocities (diagonal terms), must be positive definite in 
order that the Hamiltonian be bounded below. One ma- 
jor assumption in the above is that the density-density 
interactions are not too long-ranged, so that the spatially 
local form of © is appropriate: changing the screening 
length changes the interaction matrix and in particular 
can be used to drive a transition in or out of the QSHE 
state as shown below. The electric charges of quasiparti- 
cles are specified by an integer vector t. 

For the current models of the QSHE&ifliii, there are 
only integer excitations and if is a diagonal matrix of 



K 





-In 



(4) 



where n is the number of time-reversed pairs of edge 
modes, and /„ is the n x n identity matrix. Each mode 
carries unit charge. We will focus on the case n = 1 of 
the graphene modeli^, and the case n — 2 that is ap- 
propriate for some semiconducting models 11 . Some brief 
statements on n > 2 cases are also included below. 

The new feature of QSHE models compared to pre- 
vious work on the quantum Hall effect is that there 
are additional restrictions beyond charge conservation 
on scattering processes. Scattering by spatially random 
quenched impurities is described by the action 



Si = j dxdTl((x)e> m >*> +("(x)e 



-irrij <pj 



(5) 



Here £ is a complex random variable and [£,(x)£,* (x')] — 
D5(x — x'), with D the (real) disorder strength. The 
integer vector m describes how many of each type of 
quasiparticle are annihilated or created by the operator 
O m = exp(imj(j)j). All allowed scattering operators rrij 
are expected to appear in a disordered sample, but most 
of these will be irrelevant in the RG sense as discussed 
in the following. The condition for charge-neutrality is 
UiK-^umj = 0. 

The calculation of disorder effects in chiral Luttinger 
liquids differs little from the earlier work of Giamarchi 
and Schulz on ordinary Luttinger liquids 24 . The first step 
is to determine the scaling dimension of scattering opera- 
tors O m in order to find out whether scattering grows or 
shrinks under rescaling. Although the scaling dimensions 
are nonuniversal (i.e., depend on the nonuniversal matrix 
V) , the universal K matrix determines a lower bound on 
the scaling dimension: 



> 



m T K 1 m 



(6) 



The specific case of a null vector (m T if _1 m = 0) has 
been labeled by Haldane as a "topological instability" 25 , 
because the conditions for such an instability to exist 
depend on the topological K matrix: the effect of such an 
instability is to remove a combination of modes from the 
low-energy theory. The goal of the rest of the paper is to 
describe when such an instability eliminates the QSHE. 

We first consider the case n = 1. The V matrix can be 
represented in SO(l, 1) Lorentz coordinates^ as 



V 
D 



= B 



v 
v 
I coshr sinhr 
I sinh t cosh r 



(7) 



where v is a nonuniversal velocity, with vi e ft = flight by T 
symmetry, and r parametrizes the rest of the V matrix. 
(The utility of this coordinate system will be clear in the 
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n = 2 case below.) The scaling dimension A of the vertex 
operator 0\ = exp(imji^j) with mi = l,rra 2 = —1 is 



2Ai = (1 -l)Bf J °) ^ 
= 2(cosh2r - sinh2r) 2 . 



1 



(8) 



However, from the above discussion of the Z 2 classifi- 
cation, in a system with a single Kramers pair of edge 
modes the above operator is not generated. Instead the 
operator 2 which transfers two quasiparticles is the 
most relevant allowed operator, with scaling dimension 
A 2 = 4Ai = 4(cosh2r-sinh2r). Both Ai and A 2 range 
from to +00 as r goes from —00 to 00: this is an explicit 
demonstration of the bound ©. Note that in experi- 
mental systems the interaction is likely to be a screened 
Coulomb interaction, which corresponds to a negative r 
as the intermode interaction strength V\i = V21 is com- 
parable to the intramode interaction strength Vii = V%i- 
The scaling dimension of an operator determines 
whether that operator is relevant in the RG sense when 
added to the clean action. The operator is relevant with 
a spatially random coefficient when A(m) < 3/2, as the 
leading-order RG flow equation for disorder strength D 



dD 



(3 - 2A)D. 



(9) 



Hence 2 is relevant when A 2 < 3/2, or when cosh2r — 
sinh2r < 3/8. For weak disorder, there is a transition 
at t = t* = i cosh -1 (73/48) where disorder becomes 
relevant and localizes both modes. The region of stability 
r < r* becomes smaller when the disorder strength is 
finite, because the parameter r is increased by D under 
RG transformations: in terms of the scaling dimension 
A 2 , the RG equation is2I 



dA 2 

dl 



8- 



(2v)v 



2A 2 



rAo -D. 



(10) 



The Kosterlitz-Thouless-like RG flows near the critical 
point are similar to those found in R.eflTfil for the v = 2/3 
quantum Hall state. 

Since r* is positive, the QSHE in this model is stable 
to weak disorder if the intermode interaction V12 = V21 
vanishes, as suspected in Ref^. However, one expects 
screened Coulomb interactions to be described by in- 
creasingly positive r as the screening length is increased. 
This suggests, first, that one should look for this type 
of quantum spin Hall effect in systems with strongly 
screened interactions, and second, that the QSHE may 
disappear as the screening length is increased, e.g., by 
changing the gates near a 2DEG. This transition is quite 
sharp even if the experiment is done using current tech- 
niques where spin accumulation rather than spin currents 
are measured, although the amount of steady-state spin 
accumulation is determined by nonuniversal decay pro- 
cesses. The width of the transition is set by how the 
localization length depends on the parameter that tunes 



the interactions; the Kosterlitz-Thouless RG flows im- 
ply that this length scale diverges exponentially near the 
transition point, so even slightly away from the transi- 
tion point the localization length is quite small and the 
edge spin conductance will be zero. 



IV. EDGES WITH MULTIPLE KRAMERS 
PAIRS OF MODES 

We now consider the stability of the n — 2 realizations 
of the QSHE. There are 6 independent parameters of the 
4x47 matrix (there would be 10 in the absence of T): 
two velocities v\ and i> 2 , one intrasector rotation param- 
eter 9, two intra-Kramers-multiplet boosts Ty 2 , and one 
inter-Kramers- multiplet boost tq'- 



V = BfBcR 



fvi 

v 2 



V 




R T B C B T . (11) 



Here the rotation and boost matrices are 




R 



Bj 1 — 



Bo = 



The point of this representation is that the rotation and 
velocity parameters do not affect scaling dimensions of 
vertex operators 2 ^. 

Now the lowest allowed operators either transfer one 
particle from a mode to the mode in the other direc- 
tion that is not T conjugate to the original mode, e.g. 
m = (1,0,-1,0), or else transfer two quasiparticles 
within a time-reversed pair as above. The resulting sta- 
bility criteria for scattering to be irrelevant are, for the 
first kind. 



cosh(2rc + r)p — r|.) + cosh(2rc7 + r|, — t^) 



-2sinh2T C 



x cosh(T^ 



> 3, 



(13) 



and for the second kind, for both branches £ = 1,2 

cosh 2r c (cosh 2t 1 t - sinh2r^) > 3/8. (14) 

The region of stability in the (tj.,Tj.) plane is shown in 
Fig-Glfor several values of tq- (Obviously changes of co- 
ordinate system will change the details of these plots but 
not the topology.) The region of stability is disconnected 



in some cross-sections at constant tq but is connected 
as a 3D object. The prediction of this phase diagram, 
which is one of the main results of this paper, is that 
the n = 2 QSHE can be stabilized not only for attractive 
interactions, as expected from the single-mode case, but 
even for certain choices of repulsive interactions, which 
are more likely to appear in experiment. 

A heuristic picture of how repulsive interactions can 
stabilize the QSHE in this case is as follows. With no in- 
teractions, the operators that scatter within a Kramers 
pair are irrelevant, but backscattering between Kramers 
pairs is relevant. Turning on repulsive interactions within 
a pair will eventually make the intrapair scattering rele- 
vant, as in the case n = 1 above. However, there is an in- 
termediate regime where repulsive intrapair interactions 
increase the scaling dimension of backscattering between 
pairs and can make it irrelevant, before backscattering 
within a pair becomes relevant. 

This stabilization by completely repulsive interactions 
depends on having interpair repulsion weaker than in- 
trapair repulsion, which is likely to be the case in real 
systems. As a simple example of this stabilization, the V 
matrix for parameters tc = 0, 6 = 0, v\ = v% = 1, and 
Tj. = Tj. = 0.485 has all elements nonnegative: 

/ 1.50851 1.12943X 

[ 1.50851 1.12943 1 , 

s ~ 1.12943 1.50851 ^ ' 

\ 1.12943 1.50851/ 

The first criterion is restrictive in that decoupled 
modes (tj, = tc — 0) do not satisfy it, so that some 
small amount of interaction is necessary to stabilize the 
QSHE. Both n = 1 and n = 2 models are qualitatively 
similar, however, in that stability to disorder is contin- 
gent upon the nonuniversal interaction strengths in the 
matrix V: in this respect both are different from the or- 
dinary quantum Hall effect, where stability is guaranteed 
by the universal topological matrix K . 

It seems possible that an instability of the second type 
may localize only 2 of the 4 low-energy modes (label these 
1l, 1r, 2l, 2r according to the direction of propagation), 
by the following heuristic argument. Since the eventual 
development of a gap via the instability is nonperturba- 
tive, this perturbative RG argument may be misleading. 
When the first stability criterion 1)1 3|) is violated, both 
the operator acting to pair modes 1 l and 2r and the op- 
erator acting to pair modes 1^ and 2l are relevant (these 
have the same scaling dimension by T), so presumably 
both pairs become gapped. If the second criterion is vio- 
lated but not the first, which can happen for some regions 
of parameter space, suppose that the time-reversed pair 
is unstable to two-particle hopping while pair 2 is 
stable. This implies t\ > Tj.. Then the parameter is 
increased by RG transformations, which increases the left 
side of the first criterion (|13l) so that it remains satisfied 
and mode 2 can survive. 

For edges with n > 2 Kramers pairs, the parameter 
space is quite large: for n = 3 there are 6 independent 
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FIG. 2: Regions of stability (white) in the (tt,Tt) plane for 
values (a) to = -0.5; (b) r c = -0.15; (c) r c = -0.075; (d) 
tc = 0.5. Note that the region of stability (b) or of instability 
(c) may be disconnected, and that this topological property 
is coordinate-independent. 

boost parameters, 3 velocities, and 3 rotations: 3 of the 
boost parameters are within Kramers pairs and 3 connect 
different pairs. We can make some general comments 
based on the n — 2 analysis. Depending on the parameter 
values, it is possible for 0, 1, 2, or 3 of the Kramers pairs 
to be eliminated by scattering: operators scattering 2 
quasiparticles within a Kramers pair tend to eliminate 
just that pair, while operators connecting two pairs tend 
to eliminate both pairs. (Experimental realizations may 
have some additional symmetries beyond T that connect 
the three pairs and reduce the number of free parameters; 
for the maximally symmetric case, either or 3 pairs 
are eliminated). The n = 3 edge is actually less stable 
than the n = 1 edge in that even if all the 2-particle 
scattering processes within a Kramers pair are irrelevant, 
the processes that scatter one particle from one pair to 
another can be relevant and drive an instability. 

V. CONCLUSIONS 

Most previous work on variants of the spin Hall effect 
has concentrated on noninteracting electrons. The pur- 
pose of this paper was to understand for the quantum 
spin Hall effect the combined effect of interactions and 
disorder on the edge spin conductance. In particular, we 
reviewed how the 1i topological classification introduced 
in Ref. ^] leads to additional restrictions on scattering 
processes of edge excitations: these restrictions lead to 
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a significantly increased region of stability of the QSHE. 
The experimental conditions for the graphene case with 
free electrons are discussed in Ref. 0: a prediction of our 
work is that the Coulomb interaction should be strongly 
screened for the QSHE to be realized in that system, and 
that reducing the screening length will drive an instabil- 
ity to the insulating state. If it is someday possible to 
realize a QSHE of ultracold fermionic atoms, the inter- 
action between (charge-neutral) edge excitations will be 
non-Coulombic and additional tuning of different insta- 
bilities may be possible. 

An explicit generalization of the Z2 index of single- 
particle wavefunctions to the many-particle wavefunction 
is discussed briefly in Ref. 0. While the many-particle 
wavefunction is inaccessible in our bosonization treat- 
ment, it should be possible to confirm numerically for 
small systems in the clean case by modifying interaction 
potentials that the change in the Z2 index of the many- 
particle wavefunction occurs at the same point as the 



physical change in the spectrum of edge excitations. This 
would be direct confirmation that the Z 2 index remains a 
precisely defined concept in the presence of interactions, 
as is suggested by our finding that the edge structure is 
stable to weak interactions. 

Note added: After the completion of this manuscript, 
we learned of independent work by Wu, Bernevig, and 
Zhang— on magnetic and nonmagnetic impurities for the 
n = 1 case. Their results for quenched nonmagnetic dis- 
order are in quantitative agreement with ours. 
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